A First Look at the Evolution of Flight Crew Requirements for Emerging Market Aircraft

This is an exciting time for aviation. New vehicle and airspace technologies promise large increases in the number of aircraft in operation. One critical technology for these emerging markets is the increased use of automated systems to reduce pilot skill, training, and proficiency requirements. While the use of these systems promises to reduce or eliminate pilot functions in the long-term, the technology development for the required functions will necessitate a phased transition. The transition to, and adoption of automated systems will generate new safety challenges. This paper is a first look at a model to help frame flight crew functions for evaluation of future operational requirements. The model is intended to provide required flight crew functions regardless of whether the functions are performed by human or artificial agent. It is hoped that the model will be useful in identifying safety challenges and enabling a safe transition for the new aviation markets. The paper presents some background for a model for framing the flight crew function model and some thoughts about next steps

A Toolset for Supporting Iterative Human Automation: Interaction in Design

The addition of automation has greatly extended humans' capability to accomplish tasks, including those that are difficult, complex and safety critical. The majority of Human - Automation Interact~on (HAl) results in more efficient and safe operations, ho,,:,ever ~ertain un~~pected a~tomatlon behaviors or "automation surprises" can be frustrating and, In certain safety critical operations (e.g. transport~tion, manufacturing control, medicine), may result in injuries or. the loss of life.. (Mellor, 1994; Leveson, 1995; FAA, 1995; BASI, 1998; Sheridan, 2002). This pap~r describes ~he development of a design tool that enables on the rapid development and evaluation. of automat~on prototypes. The ultimate goal of the work is to provide a design platform upon which automation surprise vulnerability analyses can be integrated

Best Practices for Evaluating Flight Deck Interfaces for Transport Category Aircraft with Particular Relevance to Issues of Attention, Awareness, and Understanding CAST SE-210 Output 2 Report 6 of 6

Attention, awareness, and understanding of the flight crew are a critical contributor to safety and the flight deck plays a critical role in supporting these cognitive functions. Changes to the flight deck need to be evaluated for whether the changed device provides adequate support for these functions. This report describes a set of diverse evaluation methods. The report recommends designing the interface-evaluation to span the phases of the device development, from early to late, and it provides methods appropriate at each phase. It describes the various ways in which an interface or interface component can fail to support awareness as potential issues to be assessed in evaluation. It summarizes appropriate methods to evaluate different issues concerning inadequate support for these functions, throughout the phases of development

Automated Test Case Generation for an Autopilot Requirement Prototype

Designing safety-critical automation with robust human interaction is a difficult task that is susceptible to a number of known Human-Automation Interaction (HAI) vulnerabilities. It is therefore essential to develop automated tools that provide support both in the design and rapid evaluation of such automation. The Automation Design and Evaluation Prototyping Toolset (ADEPT) enables the rapid development of an executable specification for automation behavior and user interaction. ADEPT supports a number of analysis capabilities, thus enabling the detection of HAI vulnerabilities early in the design process, when modifications are less costly. In this paper, we advocate the introduction of a new capability to model-based prototyping tools such as ADEPT. The new capability is based on symbolic execution that allows us to automatically generate quality test suites based on the system design. Symbolic execution is used to generate both user input and test oracles user input drives the testing of the system implementation, and test oracles ensure that the system behaves as designed. We present early results in the context of a component in the Autopilot system modeled in ADEPT, and discuss the challenges of test case generation in the HAI domain

Some Challenges in the Design of Human-Automation Interaction for Safety-Critical Systems

Increasing amounts of automation are being introduced to safety-critical domains. While the introduction of automation has led to an overall increase in reliability and improved safety, it has also introduced a class of failure modes, and new challenges in risk assessment for the new systems, particularly in the assessment of rare events resulting from complex inter-related factors. Designing successful human-automation systems is challenging, and the challenges go beyond good interface development (e.g., Roth, Malin, & Schreckenghost 1997; Christoffersen & Woods, 2002). Human-automation design is particularly challenging when the underlying automation technology generates behavior that is difficult for the user to anticipate or understand. These challenges have been recognized in several safety-critical domains, and have resulted in increased efforts to develop training, procedures, regulations and guidance material (CAST, 2008, IAEA, 2001, FAA, 2013, ICAO, 2012). This paper points to the continuing need for new methods to describe and characterize the operational environment within which new automation concepts are being presented. We will describe challenges to the successful development and evaluation of human-automation systems in safety-critical domains, and describe some approaches that could be used to address these challenges. We will draw from experience with the aviation, spaceflight and nuclear power domains

Response Timing: Low Airspeed (Energy) Alerting

In response to NTSB Safety Recommendation A-14-043, the FAA was asked to task a panel of human factors, aviation operations, and aircraft design specialists, such as the Avionics Systems Harmonization Working Group (ASHWG), to develop design requirements for context-dependent low energy alerting systems for airplanes engaged in commercial operations. This recommendation is in association to the July 6, 2013, accident involving a Boeing 777-200ER, Korean registration HL7742, operating as Asiana Airlines flight 214, which was on approach to runway 28L when it struck a seawall at San Francisco International Airport (SFO), San Francisco, California. The FAA asked for human factor support from NASA in developing design requirements for context-dependent low energy alerting systems for airplanes engaged in commercial operations. Recently the ASHWG chair asked for continued support in examining flightcrew alert response timing and requested that NASA update the previous working paper on this subject. This product/paper will be provided to the ASHWG as part of the ongoing assignments from each of the ASHWG members in support of developing requirements and guidance for context-dependent low energy alerting systems for airplanes. The ASHWG is made up of interested parties from government and industry

Cognitive Systems Engineering: The Next 30 Years

This presentation is part of panel discussion on Cognitive Systems Engineering. The purpose of this panel is to discuss the challenges and future directions of Cognitive Systems Engineering for the next 30 years. I intended to present the work we have been doing with the Aviation Safety program and Space Human Factors Engineering project on Work Domain Analysis and some areas of Research Focus. Specifically, I intend to focus on the shift on the need to understand and model attention in mixed-initiative systems, the need for methods which can generate results to be used in trade-off decisions, and the need to account for a range of human behavior in the design

Humans, Autonomy, and eVTOLs

Electric Vertical Takeoff and Landing (eVTOL) vehicle and airspace technologies promise large increases in the number of aircraft in operation. One critical technology for these emerging markets is the increased use of automated systems to reduce pilot skill, training, and proficiency requirements. While the use of these systems promises to reduce or eliminate pilot functions in the long-term, the technology development for the required functions will necessitate a phased transition. The transition to, and adoption of automated systems will generate new safety challenges. This presentation discusses current safety challenges, new challenges for eVTOLs, and some research focused on addressing these challenges

Understanding Current Safety Issues for Trajectory Based Operations

Increases in procedural complexity were investigated as a possible contributor to flight path deviations in airline operations. Understanding current operational issues and their causes must be embraced to maintain current safety standards while increasing future functionality. ASRS data and expert narratives were used to discover factors relating to pilot deviations. Our investigation pointed to ATC intervention, automation confusion, procedure design, and mixed equipment as primary issues. Future work will need to include objective data and mitigation strategies